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Statement of Focus 


The Wisconsin Research and Development Center for Cognitive Learning 
focuses on contributing to a hetter understanding of cognitive learning by 
children and youth and to the improvement of related educational practices. 
The strategy for research and development is comprehensive. It includes 
basic research to generate new knowledge about the conditions and processes 
of learning and about the processes of instruction, and the subsequent devel- 
opment of research-based instructional materials, many of which are designed 
for use by teachers and others for use by students. These materials are tested 
and refined in school settings. Throughout these operations behavioral scien- 
tists, curriculum experts, academic scholars, and school people interact, 
insuring that the results of Center activities are based soundly on knowledge 
of subject matter and cognitive learning and that they are applied to the im- 
provement of educational practice. 
This Technical Report is from the Project on the Structure of Concept 
Attainment Abilities in Program 1 and from the Quality Verification Program. 
The Concept Attainment staff took primary initiative in identifying basic 
concepts in language arts at intermediate grade levels, while the Quality 
Verification Program assisted in developing tests to measure concept achieve- 
ment and identifying reference tests for cognitive abilities, The tests will be 
used to study the relationships among cognitive abilities and learned concepts 
in various subject matter areas. The outcome of the Project will be a formulation 
of a model of structure of abiliti2s in concept attainment in a number of subjects, 
including mathematics, science, and social studies, as well as language arts. 
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Abstract 


Test development efforts for Constructing 12 items to 
measure achievement of each of 30 seiected language arts 
concepts are described. Item and total score statistics for 
data collected on 186 boys and 259 girls who had just begun 
the sixth grade are presented and discussed. 


The primary objective of the project en- 
titled "A Structure of Concept Attainment Abil- 
ities" (hereafter referred to as the CAA Project) 
is to formulate one or more models or struc~ 
tures of concept attainment abilities, and to 
assess their consistency with actual da‘a. 

The major steps for attaining this primary ob- 
jective were taken to be: 


1, To identify basic concepts in language 
arts, mathematics, sciemce, and so- 
cial studies appropriate at the fourth 
grade level, 


2. To develop tests to measure achieve- 
ment of these concepts, 


3. To identify reference tests for cogni- 
tive abilities, and 


4, To study the relationships among 
learned concepts in these four sub- 
ject matter fields and the identified 
cognitive abilities. 


This paper describes the test development 
efforts for measuring achievement of selected 
concepts in language arts; thus, it is a report 
of one aspect of Step 2. As such, it will in- 
clude descriptive item and test statistics for 
the tests developed. The items can be found 
in "Items to Test Level of Attainment of Lan- 
guage Arts Concepts by Intermediate~Grade 
Children" (Golub, Fredrick, Nelson, & Frayer, 
1971b). 

Concepts may be defined in one or more 
of four ways: (a) structurally, in terms of 
perceptible or readily specifiable properties 
or attributes; (b) semantically, in terms of 
synonyms or antonyms; (c) operationally, in 
terms of the procedures employed to distinguish 
the concept from other concepts; or (d) axiom- 
atically, in terms of logical or numerical rela- 


Introduction 


tionships (Klausmeier, Harris, Davis, Schwenn, 
& Frayer, 1968). "A concept exists whenever 
two or more distinguishable objects or events 
have been grouped or classified together and 
set apart from objects on the basis of some 
common feature or property of each" (Bourne, 
1966, p. 1). The concept of Bourne's defini- 
tion might be called a classificatory one and 
seems to be the same as the structural type 
discussed by Klausmeier et al. (1968). This 
is the type of concept with which this project 
is concerned, and such a definition of a con- 
cept served as the basis for selection and 
analysis of subject matter concepts. 

Many different types of performance might 
be taken as the critical evidence that a stu- 
dent does or does not understand a given con- 
cept. Thus, as a part of this project it is 
necessary to have a schema for measuring 
understanding of a concept. Such a schema 
was developed by Frayer, Fredrick, and Klaus- 
meier (1969) and was used by the CAA Project 
to assess concept attainment. The "Schema 
for Testing the Level of Concept Mastery" 
consists of 13 types of questions, eachin-  . 
volving a different task required of the exam- 
inee. The schema also allows for selection 
of an answer (multiple-choice type questions) 
or for production of an answer (completion 
type questions). It was decided to use the 
first 12 tasks and a multiple-choice format 
for this project. The 12 tasks of the schema 
which were used are: 


1. Given the name of an attribute, se- 
lect an example of tiie attribute. 


2. Given an example of an attribute, se- 
lect the name of the attribute. 


3. Given the name of a concept, select i 
_an example of the concept. 


4. Given the name of a concept, select 
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a nonexample of the concept. 


5. Given an example of a concept, se- 
lect the name of the concept. 


6. Given the name of a concept, select 
the relevant attribute. 


7. Given the name of a concept, select 
the irrelevant attribute. 


8. Given the definition of a concept, 
select the name of the concept. 


9. Given the name of a concept, select 
the definition of the concept. 


10. Given the name of a concept, select 
the supraordinate concept. 


11. Given the name of a concept, select 
the subordinate concept. 


12. Given the names of two concepts, 
select the relationship between them. 


Single- or compound-word classificatory 
concepts (those that are defined by attributes) 
in language arts subject matter at the fourth 
grade level were identified. This task was 
subdivided into four steps: 


1. Identification of the major areas with- 
inthe subject matter of language arts, 


2. Selection of three of these major areas 
to be studied, 


3. Identification of classificatory con- 
cepts within each of these three major 
areas, and 


4, Random sampling of ten concepts from 
those identified for each of the three 
major selected areas. 


’ This yielded a total of 30 language arts con- 


cepts to be studied by the project. A list is 
given in Table 1, by area, of the concepts 
identified and randomly selected for study. 
The areas are Words, Words in Sentences, 


and Connected Discourse. A description of 
the procedures used to identify these concepts 
can ke found in "Selection and Analysis of 
Language Arts Concepts for Inclusion in Tests 
of Concept Attainment" (Golub, Fredrick, Nel-» 
son, & Frayer, 1971a). 

The researchers of Project 101, Situational 
Variables and Efficiency of Concept Learning, 
developed a system for analyzing a concept 
in preparation for developing items to measure 
the level of attainment of that concept (Frayer, 
Fredrick, & Klausmeier, 1969). Since the 
publication of that paper they, in cooveration 
with the researchers of the CAA Project, have 
refined their thinking and advanced this sys- 
tem. The refinements are discussed in "A 
Structure of Concept Attainmer.t Abilities: 

The Problem and Strategies for Attacking It" 
(Harris, Harris, Frayer, & Quilling, in press), 
Briefly, a concept may be described in many 
ways: interms of its criterial, relevant, and 
irrelevant attributes; its examples and non- : 
examples; its supraordinate, coordinate, and ; 
subordinate hierarchical relationshios (the- , 
oretically determined); and its lawful or other 
types of relationships to other concents. Know- 
ledge of each of these kinds of information may 
be tested to determine a student's level of 
attainment of a concept. An analysis, along 
these lines, of each of the 30 sampled lan- 
guage arts concepts which are being studied 
can be found in "Selection and Analysis of 
Language Arts Concepts for Inclusion in Tests 
of Concept Attainment" (Golub, Fredrick, : 
Nelson, & Frayer, 197la). 

Thus, using the analysis of a concept as 
the basis for appropriate content and the 12 ; 
tasks of the schema as the basis for appro— 
priate tasks, 12 items were developed for 
each of the 30 concepts. There was one item ! 
for each of the 12 tasks (except for Task 11 
for five of the concepts which had no appro= 
priate subordinate concept identified), making 
a total of 355 language arts items which were 
developed for the purpose of measuring and 
assessing concept attainment in language 
arts. The development of the items, along 
with item and total score statistics (for con- 
cepts and for tasks) obtained for them for 
beginning sixth grade boys and girls, will 
be discussed in the follewing sections. 
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Table 1 
Language Arts Concepts Categorized by Area 


Area I 
Words 


*abbreviation 
antonym 
apostrophe 

*com pound word 

*consonant 
consonant blend 

*contraction 

‘homonym 
hyphen 
long vowel 
meaning 
prefix 
rhyme 
root word 

*short vowel 

*silent Letter 
specific word 

*suffix 
syllable 

*synonym 
vowel 

*word 


Area II 


Words in Sentences 


*adjective 
adverb 
capital letter 
colon 
comma 
command 
common noun 
connector 
determiner 
exclamation 
2xclamation mark 
forms of be 
forms of have 

*helping verb 
main verb 
modifier 
negative 
noun 
past tense 

*period 
olural noun 

*possessive noun 

* predicate 
preposition 

*present tense 

* pronoun 
proper noun 
question 


. *question mark 


regular verb 
request 


. *dentence | 


singular noun 
statement 
subject 
tense 

*verb 


* Gonce pts that were selected for testing. 


Area _ Ill 
Connected Discourse 


body 
business letter 
closing 
*comparison 
conclusion 
description 
*detail 
anvelope 
example 
*explanation 
*greeting 
*heading 
indentation 
inside address 
invitation 
mailing address 
main idea 
narration 
order of ideas 
*paragra ph 
poetry 
quotation 
*return address 
signature 
social letter 
StOry 
supporting sentence 
*thank you letter 
theme 
*title 
*topic sentence 


This section contains a discussion of the 
item development procedures used including 
initial item construction and revision of those 
items based on item analysis results. Also 
included is a discusgion of the data collection 
procedures, subjects, and treatment of the 
data. 


Test Development 


One item for each of the 12 tasks was 
generated for each of the 30 selected concepts, 
with the exception of Task 11 for five of the 
concepts. Ifone looks at the tasks used to 
measure understanding of the concept, it is 
apparent that there can be more than one item 
generated for at least some of the tasks. For 


example, a Task 1 type item could be constructed 
to measure understanding of each of many rele- 
vant attributes for most concepts. For this pro- 
ject, it was deciced to construct just one mui- 
tiple-choice item for each task for each concept. 
This made it necessary to.have bases for making 
choices when such choices were necessary. 
These bases consisted of principles for select- 
ing attributes, relationships, incorrect choicss, 
etc. Adiscussion of such buses may be found 
in "A Structure of Concept Attainment Abilities: 
The Problem and Strategies for Attacking It” 
(Harris et al., in press). 

General procedures for item construction 
included initial item generation by a subject 
matter specialist item writer; critique of the 
items by a Committee composed of the item 
writers from each of the four subject matters 
being studied (the other three are mathematics, 
science, and social studies), an experienced 
elementary school teacher specializing in read- 
ing, anda measurement specialist; and final 
critique by the subject matter principal inves— 
tigator and a measurement specialist. Con- 
cerns in the item construction process were 
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readability, validity, and reliability. 


Readability 


It was intended that no student shouid 
be unable to answer an item correctly simply 
because of inability to read the item. In 
writing items, very simple language was used 
wherever possible. Several pilot studies con- 
cerned with the readability question were con- 
ducted, and two oulside consultants expert 
in the testing and measurement fields were 
asked to look ata sample of the items from 
the point of view of readability for fifth graders. 
No significant differences were found among 
treatment groups studied; percentage of occur- 
rence of subjects who could not pronounce the | 
word and did not know its meaning when shown 
the concept labels, but did know its meaning 
when the word was pronounced, was judged to 
be negligible; and the two outside consultants 
independently advised that there was no read- 
ing problem with the items and that there should 
be no concern about administering them in the 
standard way in which the students read the 
items themselves. The conclusion drawn from 
the results of the pilat studies and the con- 
cultants' opinions was that readability of the 
items was not a problem and standard admin- 
istrtion conditions would be satisfactory. 
For further information see Harris et al. (in 
press). 


Validity 


The content validity of each of the items 
was of immediate concern during item construc- 
tion; aspects of construct validity were to be 
probed later using duplicate test construction, 
simPlex analysis, and factor analysis of the 
results obtained using the content-valid items 


re) 
ERIC 


CONCEPTS 


Area 3 | Total Score 
20|21 22. ..... 30 for Tasks 


TASKS 


12 


Total Score 
for Concepts 


Fig. 1. Item matrix for each individual. 


constructed. 

Content Validity. Each item was con- 
structed to meet the content and task specifi- 
cations set for it. The task required of the 
student by each item was specified by the 
schema adopted for use in measuring concept 
attainment. The concept name was given by 
the sampling process; the attributes, examples, 
definition, and relationships associated with 
the concept name were defined by the prior 
analysis of the concept. The content for each 
item was specified in this manner. The con- 
tent specifications were not as precise as the 
task specifications due to the necessity of 
choosing a single attribute to be tested for 
example and selecting the incorrect alterna- 
tives to be used in the multiple-choice ques -— 
tions. Systematic construction of alternate 
choices was used whenever possible; for 
example, for an item dealing with a type of 
sentence, other types of sentences (or exam- 
ples of them) were used as incorrect choices, 
e.g. exclamation, question, statement. 

To further ensure the content validity of 
the items, two persons who were familiar with 
the schema for testing concept attainment, but 
were not involved in the item development pro- 
cess, classified five random sets of 72 items 


(12 items for six concepts in each set) accord- 
ing to content andtask. These two persons 
had the analysis of the concepts available. 
They were able to correctly classify all buta 
few of the items. Any questions they had about 
these few items were mutually resolved among 
the subject matter principal investigator, the 
measurement specialist, and themselves. 


Reliability 


Developing one item for each of the 12 
tasks for each of the 30 selected concepts 
yields a12 (tasks) by 30 (concepts) matrix 
consisting of the score for each of the 360 
items, one for eachcell of the matrix, for 
each individual to whom the items were adnin- 
istered. Thus, a completely crossed design 
exists and two types of total scores can be 
secured from this matrix: a total score for 
each of the 30 concepts (totalled across tasks) 
and a total score for each of the 12 tasks (to- 
talled across concepts). Figure l is an illus- 
tration of such a matrix. 

This design offers these alternatives: 

(a) useatotal scoreof 360 items to analyze 
all items against; (b) use 30 total scores, 


each for one concept and consisting of 12 items, 
( to analyzethe 12 task items against; and (c) 
use 12 total scores, each for one task andcon- 
5 sisting of 30 items, to analyze the 30 concept 
items against. The first alternative was re- 
jected since it assumes neither task nor con- 
cept variation is present. A choice was not 
made between the next two alternatives. In- 
stead, both were done. An important theoret- 
ical problem of howto item analyze a com- 
pletely crossed design like this remains to 
be solved. 

Major concerns about reliability for the 
test development process were that internal 
consistency reliability estimates for task 
sccres (total of 30 items across concepts) and 
concept scores (total of 12 items across tasks) 
be high enough to warrant further study using 
such scores, It was recognized that there 
might be some Contradictions in what was at- 
tempted. The items were constructed to comply 
with the completely crossed design, 30 con- 
cepts by 12 tasks. One major objective of 
the entire project is to determine the dimen- 
stonality of the selected language arts con- 
cepts andof the tasks when using language 
arts content. If eitheror both of these are 
not unidimensional, then an internal consis- 
tency reliability estimate based upon items 
measuring aspects from the multidimen sions 
would reflect this; the more dimensions pre- 
sent and the moreuncorrelated they are, the 
lower the internal consistency estimate. Re- 
cognizing this, and not being able to study 
the dimensionality of the two modes (concepts 
and tasks) until after the items were developed, 
pilot studies were conducted using the items 
for some of the concepts for the 12 tasks. 

As will be pointed out later, evidence indi- 
cates that sufficiently reliable scores can be 
obtained for both task scores and concept 
scores, 


Item Revision 


If one looks atthe 12 tasks for a single 
concept it becomes quite apparent that there 
may be a strong learning effect as one attempts 
to answer the items, The name of the concept 
appears inevery item, except for the first two 
which deal with an attribute of the concept, 
either inthe stem oras a possible choice, 
This makes a random presentation of the items 
desirable. Using items for six of the mathe- 
matics concepts presented on mark sense type 
cards, a study was conducted in which one 
group of subjects responded to the items ar- 
ranged inthe same random order (over 72 items 
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for the six concepts) common te: all subjects, 
The second’ group of subjects responded to 

the items arranged in a random order (over 

72 items for the six Concepts) whichwaés a 
unique one for each subject of the group. No 
significant differences in test score were 

found between the subjects receiving a common 
random order and those receiving a unique ran- 
dom order, 

Tryouts of the language arts itens for item 
analysis and revision purposes were conducted 
using a single random order over the items for 
six concepts contained in atest booklet. This 
constituted a "test" of 72 iteras which could 
readily be administered in! hour. The tryouts 
were conducted during Octbber, 1969, and 
January, 1970, with fifth grade- students in 
the Madison, West Allis, and Sussex, Wis- 
consin school systems. Approximately 100 
students (fewer for the Madison sample) re~ 
sponded to each "test," Madison students 
were given the items for six of the concepts 
in October; West Allis and Sussex students 
responded to the items for 12 concepts in 
January. 

The tryout data were subjected to the 
Generalized Item Analysis Program (GITAP) 
(Baker, 1969), the output of which provides 
the proportion responding, item—criterion 
biserial correlation, X59 (point on the criterion 
scale corresponding to the median of the item 
characteristic cirve), and @ (the reciprocal of 
the standard deviation of the item characteristic 
curve which is a measure of the discriminating 
power of the item) for each possible choice for 
each item as well as summary descriptive statis- 
tics for the total test. It also gives the Hoyt 
reliability for the total test and the standard 
error of measurement. 

As discussed earlier, the design for these 
language arts achievement items is one in 
which the concepts and tasks are completely 
crossed. Since there are no item analysis 
procedures available for completely crossed 
designs, the data were analyzed in each of 
the two possible ways—each item as part of 
the appropriate concept score and as part of 
the appropriate task score. This raises ques- 
tions as to the interpretation of suchresults. 
The main referents used for interpreting the 
results and asa basis for making item revi- 
sions were theresults obtained from the analy- 
ses of the concept scores. The tasks were 
fixed and thus any arbitrary decisions were 
made in regard to appropriate content for in- 
correct Choices, etc. Usual standards for 
item indices were not strictly adheredto, as 
aunique design for item analysis was being 
used and a major objective of the project is 
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to study the dimensionality of the concepts 

and of the tasks. If high discrimination in- 
dices were demanded, the dimensionality 
might have been affected by making the items 
more homogeneous. Also, no attempt was 
made tc: manipulate the difficulty level of the 
items, Since anotl.er objective of the project 
is to determine if any differential levels of 
difficulty, or compl’::.ity, exist in the con- 
cepts and inthe tasks. Therefore, the item 
analysis results were used as a very general 
guide to help in determining whether there 

were "hidden" weaknesses, clues, and/or 
incongruities inthe items and, in aneven 

more general sense, to show that what we 

were attempting to do was possible—sufficiently 
reliable concept and task scores could be ob- 
tained v7hen using this completely crossed de- 
sign. 

The revised items can be found in "Items 
to Test Level of Attainment of Language Arts 
Concepts by Intermediate Grade Children" 
(Golub, Fredrick, Nelson, & Frayer, 1971b). 


Subjects 


Pilot studies revealed that the concepts 
selected were very difficult for fourth graders. 
Thus, the decision was made to test fifth 
grade students with the concepts identified 
as generally taught to students during the 
fourth grade, 

The language arts items were administered 
to 186 boys and 259 girls who were just be- 
ginning the sixth grade during the fall of 1970 
in the public school system of Madison, Wis- 
consin. ‘The subjects were students who 
volunteered to participateas a resultofa 
letter sent toarandom selection from the 
population of all such boys and from the popu- 
lation of all such girls. Approximately 60% 
of those invited to participate in the testing 
responded affirmatively. The subjects who 
completed the testing program were paid 
$7.50. 

Since the participation of all students 
comprising the random sample was impossible 
to attain, test scores and IQ data were ob- 
tained from the files of the Madison Public 
School System for those students for whom 
the information was available. Table 2 in- 
cludes the summary statistics for the population 
of fifth grade students in the public school sys- 
um of the city of Madison during the school 
year 1969-70, and for the boys and the girls 
who comprised the tested samples for the 
language arts items. The Lorge~Thorndike 
Intelligence scores were obtained in the fall 
of 1968 when the subjects were fourth graders, 
and the scores onthe Iowa Tests of Basic 
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Skills, given in grade equivalent scores, 
were obtained in the fall of 1969 when the 
subjects were fifth graders. 

Data on fathers' occupations were col- 
lected from the students using the Master 
Occupational Code of the United States Bureau 
of the Census. These data were tabulated and 
are presented in Table 3. 


Data Collection 


The data were collected during five 2-hour 
testing sessions in mid-October to early Novem- 
ber. Since a large percentage of sixth graders 
attended one of three middle schools, it was 
decided to test the selected students from 
those schools in their own buildings after 
schoolhours. The sixth grade students attend—- 
ing various elementary schools were tested on 
three consecuiive Saturday mornings at centrally- 
located schools. Each 2-hour session consisted 
of a 72-item “test” composed of language arts 
items, a 72-item "test'' composed of science 
items, and an activity break between the two. 
The language arts and the science items were 
given first on alternate days, 

The language arts items were arranged in 
five 7l-item "tests." The order of the items 
was assigned randomly over the potential 360 
items. Two different random orders were used 
to collect the data: one for each type of school 
for both boys and girls. The items were arranged 
in five test booklets according to the random 
order. The students responded to each item by 
marking their chosen response directly on an 
answer sheet. The answer sheets were read 
by machine and the responses punched onto 
data cards. The tests were given by exper- 
ienced test administrators to groups of approx- 
imately 30 subjects each. 


Treatment of the Data 


The treatment of the data consisted of 
two main procedures: reliability estimation 
and item analysis. The data were analyzed 
separately for each sex group. Hoyt analysis 
of variance reliability estimates were obtained 
for each of the 30 concept scores and eachof 
the 12 task scores for each group studied. 
Means and standard deviations for each of 
the scores were also computed. 

Item analyses using the GITAP program 
(Baker, 1969) were obtained for each of the 
items asa part of two different scores: an 
appropriate concept score and an appropriate 
task score. This program provides proportion 
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Table 2 
Test Data for Population and Samples 


Test 
Lorge-Thorndike Intelligence Xx 
s 
N 
Iowa Basic Skills _ 
Vocabulary xX 
s 
N 
Reading Comprehension x 
s 
N 
Language Skills xX 
s 
N 
Work-Study Skills xX 
s 
N 
Arithmetic Skills [ 
s 
N 
Composite X 
s 
N 


responding, item-criterion biserial correlation, 
Xsq, and 8 statistics for each choice of each 
item. The proportion of students who respond 
correctly to an item is an index of the difficulty 
level of that item. The greater the value of 
the difficulty index, the easier the item. The 
biserial correlation coefficient is an index of 
the discriminating ability of the item choice, 
For these analyses the criterion ability used 
was total concept or total task score. X59 

is the point on the criterion scale, given in 
standard deviation units, corresponding to 

the median of the item characteristic curve. 

It fs the point at which subjects with that 
score have a 50-50 chance of choosing that 
response. 8 is the reciprocal of the standard 
deviation of the item characteristic curve at 
the Xsqg point. It is an index of the discrim- 
ination power of the item. 

When interpreting the data in the tables 
of this report, the reader should note that the 
Hoyt reliability coefficient is a measure of 
internal consistency. It indicates the extent 


Population Boys Girls 

106.60 106.1) 112.23 
14,82 13.37 

2605 161 239 
S.<53 5.54 5.88 
1.41 1.33 

2520 11 246 
5.44 5.29 5.97 
1.51 1.35 

2520 i81 247 
5.24 5.04 5.82 
1.44 1.34 

2520 181 248 
5.46 5.41 5.86 
1.30 1.18 

2520 18] 248 
5.95 5.08 wees 1) 
-96 1,00 

2520 181 247 
5.35 5.27 5.77 
1.17 1.11 

2520 181 245 


to which a group of items measures the same 

trait or ability. For tests constructed in the 
present manner (that is, to test attainment of 

a concept at various levels) the Hoyt reliability 
may be low, thereby reflecting the various 

levels of concept attainment and not necessarily 
indicating a poor groupof items. The item analy- 
sis data provide guidelines for deciding whether 
a particular item should be revised, The per- 
centage of Ss correctly responding to an item ; 
is optimal as it approaches 50%. Those items 
that are too easy (over 90% correct responses, 
for example) or too hard (answered at a chance 
level—below 25% correct responses for a four- 
choice item, for example) may be improved 

even though they already discriminate at accept- 
able levels. The biserial correlation between 
the item response and the total score should 

be positive and at least as high as .30 for the 
correct choice, Below that level, the item is 
not contributing much, if anything, to the reli- 
ability of the total score, and should be changed 
or improved. Inthe same manner, the 8 for an 
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Table 3 


Distribution of Fathers' Occupations 


Girls Boys 


00. Accountant 

01. Architect 

02. Dentist 

03. Engineer 

04, Lawyer, Judge 

05. Clergyman 

06, Doctor 

07. Nurse 

08. Teacher, Professor 

09. Other Professional 

ll, Farmer 

21. Owner of Business 

22, Manager, Official 

31. Bookkeeper 

32. Receptionist 

39. Other Clerical 

49. Salesman - 

51, Craftsman, Skilled Worker 
52. Foreman 

53. Armed Services - Officer 
54. Armed Services - Enlisted 
61, Truck Driver 

62. Operative in Factory 

69, Other Operative 

71. Fireman 

72. Policeman 

73. Other Protective Service Worker 
74, Practical Nurse, Nurse's Aide 
75. Private Household Worker 
79, Other Service Workers 

81, Non-Farm Laborer 

82. Farm Laborer 

91, Not presently in labor force 
99, Not ascertained 


item should be +.30 or higher. The Xsq 


4 7 
3 2 
3 1 
10 7 
6 2 
-- 3 
12 3 
20 15 
26 15 
4 2 
28 13 
1 ae 
6 4 
27 24 
39 22 
-- 2 
-- 1 
-— 1 
5 4 
16 1] 
12 12 
2 2 
2 4 
3 -- 
1 1 
14 16 
3 2 
1 = 
6 6 
12 10 


that the students who have an even chance 


statistic should be small, thereby indicating of answering the item correctly score two 


that the item is functioning in the middle 


standard deviations above the mean on the 


range of difficulty. As Xso becomes large total test. Such guidelines as to reliability, 
(either below -2.0 or above +2.0) the item difficulty, and discrimination were used to 
is either very easy or very difficult. For determine and correct weaknesses and in- 


example, an Xsq of +2.0 would indicate 


10 


congruities in the item. 
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Results and Discussion 


The means, standard deviations, Hoyt 
reliability estimates, and standard errors of 
measurement are presented in Table 4 for each 
of the 12 tasks which were used to test the 
attainment of concepts. The Hoyt reliabilities 
for these 30-item tests range from .72 to .89, 
showing that each task level has a fairly high 
internal consistency, even though questions 
within a task measure 30 different and distinct 
concepts. The standard error of measurement 
averages slightly more than two points out of 
a possible 30. In general, the tasks seem 
more difficult as one moves from Level 1 to 
Level 12; however, this is not an ordered pro- 
gression. The correlation between the rank- 
order of difficulty and the task number is .@5. 
In absolute terms, it appears that students 
know attributes, examples, and relationships 
of concepts for only half to two-thirds of the 
concepts taught them in the preceding years 
of school as measured by the language arts 
items developed. 

Boys and girls differ in magnitude of scores 
at all task levels, girls scoring 2.4 to 3.7 
points higher than the boys. Onthese items 
and for this type of verbal knowledge girls are 
approximately one-half of a standard deviation 
above boys. 

A close examination of Table 4 indicates 
that although girls are approximately one-half 
of a standard deviation above boys for all tasks, 
both boys and girls find certain tasks either 
easy or difficult. The easiest task, for both 
boys and girls, is to select examples of a 
named attribute; the most difficult task is for 
them to relate logically two concepts and to 
conclude with a principle. The selection of 
a supraordinate concept is not necessarily 
difficult for the students; however, selecting 
a subordinate concept, when one is available, 
is the second most difficult task for students. 
The third most difficult task is to determine 
the irrelevant attributes of a concept, that is, 
determining what is not necessarily a distin- 


guishing feature of a concept. Table 4 pre- 
sents a reading of intermediate-grade children's 
levels of conceptualization in language arts. 
In Table 5, similer data to those in Table 
4 are presented showing the scores for each 
of the 30 concepts. The most difficult items 
(and perhaps the most difficult concepts) were 
written for the concepts Adjective, Helping 
Verb, Predicate, and Topic Sentence. The 
easiest items were for the concepts Question 
Mark, Thank You Letter, Silent Letter, and 
Sentence. For each concept, girls scored 
higher than boys by .8 to1.8 points. As is 
true for the task scores, the concept scores 
are equally reliable measures for each of the 
sex groups. The reliability estimates are 
generally lower for these concept scores (range : 
from .47 to .80) than for the task scores. This : 
may result partly from the fewer items (12 as 
opposed to 30) in the concept scores and also : 
partly from the nature of the 12 tasks. That : 
is, the different tasks for a particular conceot : 
may not be as internally consistent as the 
knowledge of the different concepts at a par- 
ticular task level. This is unlikely, however, 
since some Spearman-Brown estimates for 
tripled test lengths are: 


Estimated % 


Original 
50 .75 : 
60 .82 
. 65 685 
.70 .88 


Thus, it seems that the lower reliability esti- 3 
mates are a function of the number of items. i 

Table 5 shows that the easiest concepts 
for girls are not necessarily the easiest con- 
cepts for boys. There is some consistency, . F 
however, between the magnitude of scores 
for the boys and the girls, the average differ- ‘ 
ence being about one half of a standard devia- } 
tion, : 


gl = 


3 
ated 


Table 4 
Language Arts Test Results for the 12 Tasks 


“No, of Boys (N = 186) Girls (N = 259) 

Task No. Items Mean S.D. Hoyt R. 5S,E, Mean 5.D. HoytR, S.E. 
l 30 19 6.3 -87 2,2 23,1 5.3 . 86 1.9 
2 30 17.2 6.3 86 2,3 20.7 5.7 . 85 2.2 
3 30 18.0 539 84 2.3 21.4 5.2 - 83 2.1 
4 30 18.0 5.4 .80 2.4 21.0 5.3 - 82 2.2 
5 30 16.6 6.1 84 2.4 19.8 5.4 - 83 2.2 
6 30 15.4 6.3 .85 2.4 19,0 6,3 . 86 2.3 
7 30 14,4 5.2 75 2.5 16.8 5.3 .78 2.5 
8 30 15.6 7.0 -88 2.4 19,3 6.8 89 2.2 
9 30 16.3 6.6 87 2.4 19,5 6,4 . 87 2.2 
10 30 16,1 6.3 .85 2.4 19,4 6,0 . 86 2.2 
118 25 (30) 11.4(13,7) 4.3 -72 2.2 13,5(16,2) 4.4 075 2.2 
12 30 12,3 5.2 78 = 2.4 15.1 5.7 -82 2.4 


Mean Number = Rank- 


Correct for Order 
Task No, Task Description Boys & Girls of Tasks 

1 Given name of attribute, select example, 21.6 1 

2 Given example of attribute, select name. 19,3 4 ; 
3 Given name of concept, select example. 20,0 2 
4 Given name of concept, select nonexample. 19.8 3 
5 Given example of concept, select name. 18,5 5 
6 Given concept, select relevant attribute. 17,6 9 
7 Given concept, select irrelevant attribute. 15.8 10 ; 
8 Given definition of concept, select name. 17.8 8 
9 Given name of concept, select definition. 18,2 6 

10 Given concept, select supraordinate concept. 18,1 7 

114 Given concept, select subordinate concept. 12.7 (15.2) 11 
12 Given two concepts, select relationship. 14.0 12 


4 Five concepts did not possess appropriate subordinates. The numbers in parentheses are 
extrapolations based on 30 items. 


Of the thirty (30) concepts chosen for in- cult concepts for boys being Suffix and Syn- 
Clusion in this test, 1-10 deal with words and onym. None of the concepts in this area was 
word-forms, 11-20 deal with words in sentences, particularly difficult, 
and 21-30 deal with connected discourse. The The concepts in group 11-20 are the most 
first ten concepts, in the category of words difficult for both boys and girls. Instruction 
and word-forms, are the easiest for interme- in most of these concepts does not generally 
diate grade children. Concepts in this area start until the fourth grade. The most difficult 
are associated with reading and spelling in- concepts inthis group are Adjective, Helping 
struction started in the primary grades, The Verb, Predicate, Possessive Noun, and Pronoun. 

| easiest concepts for boys are Consonants, The easiest concepts inthis group are Period 
Short Vowel, and Silent Letter, the most diffi- and Question Mark. 
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Table 5 
Language Arts Test Results for the 30 Concepts 


Boys (i = 186) Girls (N = 259) 

No Concept Mean 8.D. HoytR. S.E. Mean §8.D. HoytR. S.E. 

1 Abbreviation 6.8 2.8 .71 LS 8.4 2.6 .72 1.3 

2 Compound Word 6.8 2.7 . 69 1.5 8.5 2.5 .70 1.3 

3. Consonant 7.3 2.6 . 67 1.4 8.4 2.4 . 68 1.3 

4 Contraction 6,2 2.9 73 1.5 7.6 3.0 77 1.4 

5 Homonym 6,8 2.7 . 69 1.4 8.3 2.5 . 69 1.3 

6 Short Vowel 7.5 2.9 76 1.4 8.6 2.7 275 1.3 

7 Silent Letter 7,4 2.8 70 1.4 9.0 2.6 74 1.3 

8 Suffix 6,0 3.3 . 80 1,4 7.2 3.3 . 80 1.4 

9 Synonym 6.1 2.8 . 68 1.5 7.6 2.7 70 1.4 

10 Word 6.8 2.8 71 1.4 8.0 2.6 .70 1.4 

1l Adjective 4,6 2.6 . 65 1.5 5.5 2.9 .72 1.4 : 
12 Helping Verb 4.9 2.2 47 1.5 5.7 2.3 252 1.5 ; 
13 Period 7.0 2.7 .67) 1.5 8.5 2.4 . 68 1.3 : 
14 Possessive Noun 5,8 2.7 . 67 1.5 6,9 2.7 . 69 1.4 
15 Predicate 5.1 2.7 . 67 1.5 6.3 3.0 74 1.5 : 
16 Present Tense 6.0 2.7 . 68 1.5 7.1 2.7 672 1.4 i 
17. Pronoun 5.5 2.7 . 66 1.5 6.5 2.8 672 1.4 : 
18 Question Mark 7.9 2.9 76 1.3 9,6 2.5 .77 1.2 : 
19 Sentence 6.9 2.9 72. 35 B.7 27 £75 163 
20 Verb 6,3 2.8 .69 1.5 Vii 2.9 75 ° 12.4 : 
21 Comparison 6.2 2.9 «72 “1,5 7.4 2.8 72 Wd i 
22 Details 6.1 2.7 . 68 1.5 7.3 2.8 .73 1.4 : 
238 Explanation 6.0 (6.5) 2.7 .70 1.4 6.7 (7.3) 2.7 .72 1.4 : 
24 Greeting 6.7 2.6 .67. 1.4 8.0 2.4 . 67 1.3 
259 Heading 4,9 (5.3) 2.3 59 1.4 5.9 (6.4) 2.5 69 1.3 
264 Paragraph 6.5 (7.1) 2.7 71 1.4 7.7 (8.4) 2.6 75 1.3 
278 Return Address 6.9 (7.5) 2.3 . 64 1.3 8.1 (8.8) 2.0 .57 1.2 
288 Thank YouLttter 7.2 (7.8) 2.7 74 1.3 8.6 (9.4) 2.3 .73 i 
29 Title 7.2 2.9 ate 1.4 8.7 2.4 . 68 13 : 
30 Topic Sentence 5.1 2.4 58 1.5 6.4 2.7 . 67 1.5 
Denotes concepts tested by 11 items rather than 12. These concepts did not have appro- “ 


priate subordinates as required in Task 11. The numbers in parentheses are extrapolations 
based on 12 items. 


The last group of concepts (21-30), deal— Table 6 gives a summary of the item data 
ing with connected discourse, represents mid— for the correct response to all 355 items. (Note 
dle-difficulty concepts. The most difficult that decimal points have been omitted in the 
concepts in this group are Heading and Topic columns of biserial R.) The items are arranged 
Sentence, the easiest being Thank You Letter by concept, and within each concept the 12 
and Title. The girls average about a half of tasks dre in order from 1 through12. Thus, 
a standard deviation above the boys. Item 14 is the data for Task Level 2 for Com- 
The level of attainment shown in Table 5 pound Word. Six percent, or 22, of the items 
for concepts taught before the beginning of had a Beta score below .30, indicating that 
sixth grade indicates some areas of needed the item might need revision to improve its 
teaching and testing emphasis, discriminating power. These 22 items are ; 
13 ‘ 
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Table 6 
Item Indices Based on Concept and Task Criterion Scores 


Percent Biserial R X50 Beta 
Item Correct Boys Girls Boys Girls Boys Girls 
No. B G C T GCG T Concept Task Concept Task Concept Task Concept Task 
Abbreviation ; 
1 65 87 56 59 89 81 -.66 -,64 -1.2€ -1.38 .68 72 1.97 1.39 
2 61 78 76 61 77 72 -.36 -.45 -1.00 -1.08 1,16 .76 1,21 1.03 
3°75 88 66 55 62 54 -1.01 -1.21 -1.94 +-2.21 .88 . 66 .78 . 64 
4 70 «84 68 63 69 62 -.77 -.82 -1.43 -1.58 92 .82 .95 . 80 
5 62 77 77 #70 62 62 -.39 -.43 -1.21 -1.21 1,19 .99 .78 .78 
6 57 68 49 38 58 51 -.36 -.47 -.82 ~.93 56 41 .72 60 
7 52 61 54 40 57 44 -.10 -.14 -.51 -.65 665 -44 .70 -50 
8 42 48 61 59 63 S7 sol, 32 . 08 09 .76 73 81 . 69 
9 49 64 73. 73 84 83 04 04 -.43 ~.44 1.06 1.07 1.58 1.46 
10 61 73 66 61 72 76 -.4l -.45 -.87 ~.82 89 77 1,02 1.16 
1} 55 72 73 S6 75 71 -.19 -.24 -.77 -.81 1.06 67 1,13 1.01 
128 30 36 32 25 50 35 1.69 2.17 74 1.06 34 25 .58 .37 
Compound Werd 
13 79 = 85 57 55 $9 51 ~-1.41 -1.47 -1.74 -2.04 .70 - 66 74 .59 
148 33 40 52 28 42 26 84 1.55 59 95 . 66 - 29 47 .27 
15 54 81 73. 70 82 77 -.13 -.14 -1.09 -1.16 1.08 97 1.44 1,21 
16 71 88 63 63 81 69 -.88 -.88 -1.44 -1.69 81 81 1.36 .94 
17 70 = 79 60 60 72 59 -.90 -.90 -l.1l1l -1.35 «74 75 1.03 74 
18 62 77 60 44 88 84 -.50 —-.68 -.85 -.89 .76 49 1.82 1.53 
19 55 73 53 46 64 54 -,26 -.29 -.97 -1.15 62 52 83 «65 
20 68 «81 67 60 67 65 -.68 -.77 -1,.31 -1.35 91 75 91 86 
21 51 73 66 67 75 71 -.02 -.02. -.82 ~.87 88 91 1.13 1.00 
22 44 S50 48 46 61 53 34 35 Ol 01 54 52 78 63 
23 52 58 63 61 45 32 -.09 -.09 -.44 ~.63 81 78 .5l 34 
24 46 63 68 66 70 67 14 14 -.45 ~.48 93 - 89 99 90 
Consonant 
25 91 9S 50 S55 58 59 -2.74 -2.48 -2.47 ~2,40 58 - 66 71 «74 
26 74 +86 59 49 71 67 ~1.07. -1. 28 -1.53 -1.61 74 97 1,00 91 
27 71 «82 83 76 84 82 -.67 -.72 -1.08 1.11 1.46 1.19 1.57 1.45 
28 68 75 59 43 55 45 -.81 -1,10 -1.20 1.45 73 - 48 66 51 
29 73 «87 72 66 82 77 -.86 -.94 -1.37 -1.45 1.03 . 87 1.44 1,22 
30 42 49 56 S57 63 66 36 35 02 02 68 70 .82 . 89 
31 44 51 43 34 57 46 239 44 -.06 -,07 47 - 36 69 51 
32 54 63 66 68 53 54 ~.14  =-.14 -.62 ~.62 88 92 .63 63 
33 72 «288i 68 58 78 73 ~,86 -1.01 -1.12 -1.21 93 70 1,27 1,06 
34 62 77 72 62 861 72 -.44 -.51 -.91 -1.02 1,05 - 81 1.37 1.02 
35 48 53 52 55 55 47 -10 10 -.13 ~.15 60 65 .65 54 
36 27.—Ss Al 54 47 63 45 1.10 1.29 36 51 65 53 .80 51 
Contraction 
37 60 74 74 64 80 79 -.35 —.40 -.81 -,82 1,11 - 84 1.32 1.30 
38 48 64 63 S9 82 72 .09 . 09 -,46 -.51 . 80 74 1.41 1.05 
39 65 75 67 65 89 77 -.56 -.57 -.75 -.87 90 - 86 1,99 1.22 
40 70 =79 54 48 58 54 -1.00 -1.13 -1.40 -1.51 . 64 54 71 64 
4l 63 +68 72 59 79 67 -.46 -.55 -.57 -.68 1,04 74 1.31 .90 
42 48 66 80 74 84 81 .05 -06 -.50 ~.52 1,33 1.08 1.55 1,40 
43 48 64 66 45 53 44 .08 12 -.68 -.82 88 - 50 62 49 
44 42 54 71 62 79 69 29 33 -.14 -,16 1,01 79 1,27 95 
45 53 63 63 SO 75 57 -.13 -.16 -.45 ~,60 82 -58 1,14 . 69 
46 52 68 63 64 63 47 ~.06 -.06 -.76 -1.01 82 - 84 .80 53 


@ Denotes Beta scores below .30. Item might need revision. 
14 i 
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Table 6, (Continued) 


Percent Biserial R X50 Beta 
Item —— Bove girls Boys Girls Boys Girls 


No. T Concept Task Concept Task Concept Task Concept Task 


Contraction (continued) 


474 32 29 24 13 10 «01 1.50 3.54 5.74 46.25 225 213 .10 .O1 
48 40 56 59 Sl 76 79 .44 sol -.21 -.20 73 «59 1,16 1.29 
Homonym 

49 67 77 73 63 S52 49 -.59 -.68 -1.40 -1.49 1.05 82 . 61 256 
50 61 82 75 81 73 = «73 -.36 ~-,34 -1.24 -1.24 1.13 1,36 1.07. 1.98 
51 65 75 7i 59 76 61 -.54 <-.65 -.90 <-1.12 1.02 274 1.18 77 
52 81 88 65 50 77 67 -1.35 -1.76 -1,54 -1.78 86 .98 1,23 91 
53 77 «81 64 63 72 62 -1.14 -1.16 -1.23 -1.42 .84 82 1,03 79 
54 47 69 63 52 71 75 oll 13 -.71 -.67 .80 .61 1.00 1.13 
55 65 80 67 59 69 39 -.56 -,63 -1,24 -2.20 .89 73 .94 42 
56 46 55 65 42 60 53 17 26 -.20 -.23 86 46 .74 ~..62 
57 58 69 57 44 66 57 -.33  -.43 -.74 -,.86 .69 49 . 88 .69 
58 54 71 54 65 82 84 -.17  -.15 -,. 68 -.66 .65 .85 1.41 1.53 
598 22 32 15 -05 30 22 5.42 16.31 1,50 2.08 hs -.05 132 22 
60 39 54 63 49 61 58 46 59 -.18 -.19 81 .56 .76 71 


61 84 91 65 82 75 75 <-1.51 -1.21 -1.79 -1.81 .86 1.41 1,15 1.11 


62 62 75 73 69 70 60 -.43 -.46 -.98 -1.13 1.05 94 .97 76 
63 86 85 72 58 67 62 -1.50 -1.86 -1.54 ~1.68 1.04 71 91 478 
64 70 84 66 53 71 70 -=.79 =.98 1.39 -1.41 .89 .63 1.01 .97 i 
6 69 82 72 56 66 58 -.70 -.90 1.39 -1.56 1.04 . 68 .87 .72 : 
66 49 64 66 65 81 63 02 ,02 -.43 -.55  .87 685 1.39 .81 
67 47 53 52 49 55 45 as 17 s=,11 “4,14 62 56 66 .50 
68 58 64 68 59 75 64 -.28 -.32 -.50 -.58 .92 173. «1.12 ~=«.84 
69 51 67 75 58 79 67 -.02 ~-.02 65 12,65 05 .70 1.27 + .89 
70 60 71 69 5S 79 73 =.38 =.47 -.70 -.76 95 66 1.30 1.08 
71 60 70 85 73 75 66 -,30 -=.36 =7l =,81 1,62 1,06 1,12 87 
72 49 57 56 52 55 58 .02 03 = 3F. 2,99 67 61 66 72 
Silent Letter i 
73 67 86 76 75 95 91 -.57 -.58 -1.12 -1.16 1.16 1.12 3.11 2.26 | 
74 70 85 69 66 80 74 -.78 -.82 -1.32 -1.42 .96 .87 1.33 1.10 ; 
75 84 90 54 49 55 48 -1.84 -2.00 -2.29 -2.65 65 57 .66 54 
76 60 79 65 58 89 76 -.40 -.44 -.90 -1.05 84 72 1.91 1.18 
77, 65 85 74 66 78 67 -=.50 -.57 =-1.31 -1.52 1,12 87 1.24 90 
78 1 65 S&B 58 65 55 -.05 =,05 -.59 -.69 71 71 85 66 | 
79 63 70 45 38 52 43 -.74 -=.87 -1.02 -1.25 4.51 41.61 ~— 47 
80 57 74 #70 62 76 67 -=.25 -.28 -.85 -.96 98 79 1.16 91 
81 54 64 52 55 S56 43 -.18 =.17 -.66 -.87 62 65 68 47 
82 59 70 64 54 70 65 -.34 ~,40 -.76 ~-.81 83 65 .98 87 
83 69 78 58 42 70 5S -=.87 -1.21 -1.11 -1.40 71 46 .97 66 { 
84 44 56 62 60 78 74 24 25 -.18 -.19 80 75 1.23 1.09 
Suffix Lo 
85 47 70 57 64 5S 61 <2 ll =,93 =.89 70 84 66 7% 
86 S52 62 68 61 67 S56 -=.08 ~=,09 ~,45 -.53 93 AG 90 68 
87 52 66 80 71 79 62 -.07  ~=.08 = 6 =,65 19 Ll 1.23 78 i 
88 45 56 60 49 68 49 .20 £25 0 8 9G 74 56 .92 56 | 
89 53 70 85 69 90 70 ~.10 -.12 =,67 =,72- 1,62 96 2.04 98 | 
90 51 69 62 63 67 60 -.02 -,02 =73 =,81 79 80 .90 75 | 
91 44 46 55 52 64 51 .30 ai 17 522 66 61 .83 59 ; 
92 54 63 79 67 81 65 -.14 =,16 =41 =,50 1,30 91 1.39 86 | 
93 46 58 80 62 67 46 13 18 30 -.44 1,34 78 .90 51 | 
15 | | 
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Table 6, (Continued) 
( Percent Biserial R X50 Beta 
se ae a ats Boys Boys Cirls 
j Concept Task cena Task Concept Task Concept Task 


Suffix suite (Ge ncauad 


94 67 71 70 S8 86 87 -.64 -.77 -.65 -,.64 .97 -70 1.66 1,74 
95 “46 47 73° 0658 ‘66 $3 13 16 el? 16 1,06 71 .88 .62 
96 40 46 72 61 #77 «63 34 40 12 15 1.04 .77' «1,19 .80 
Synonym 
97 58 76 65 57 64 62 -.29 -.34 -1.08 -1.12 85 . 69 84 .80 
98 54 71 53. 57 79 69 -.18 -.17 ~.68 ~.79 .62 -69 1,30 95 
99 37s 45 52 30 62 38 63 1.10 . 20 32 61 631 79 41 
100 62 «81 63 58 71 64 -.50 -.54 -1,22 -1,36 81 72 1.01 82 
101 4\ 49 71 54 71 #S9 33 43 . 03 .04 1.00 -64 1.00 .73 
102 59 64 56 40 52 44 -.41 -.57 ~. 68 ~.80 , 67 44 61 49 
103 49 65 61 45 58 49 04 06 -.67 ~.81 78 50 .72 656 
104 58 78 75 70 65 68 ~,25 -,27 ~1,17 -1.11 1.14 99 .85 93 
105 61 73 65 58 76 64 ~.44 -.49 -.82 ~.97 85 72 1,16 84 
106 53 66 60 67 70 67 ~.11 -.10 ~.59 -,62 75 90 .99 96 
107 27-37 37. 39 41 30 1,62 1,54 .78 1,05 40 ~42 045 +32 
108 50 57 54 46 57 50 .00 -00 -.31 -,36 64 53 .70 58 I 
Word 
109 69 78 65 60 69 73 -.78 —,84 -1.14 -1,08 86 075 .96 1,07 
110 36 = 45 45 40 45 39 . 80 89 27 31 50 44 .50 42 
lll 67 78 75 61 55 57 -.59 <=-—.73 -1.42 -1,37 1,14 .76 66 70 
112 84 92 64 64 82 67 -1.57 -1.58 -1.71 ~-2.10 84 83 1.41 90 
113 35 44 53 44 53 37 .70 84 . 26 .38 . 63 49 63 40 
114 48 51 58 46 54 41 .09 «12 -.06 ~,08 71 51 64 «45 
115 61 70 57 45 66 51 -.51 -.64 -.80 -1,04 69 .50 .88 .59 
116 40 51 64 49 S8 5S6 41 +53 -.06 -.06 82 256 72 67 
117 70 ~=680 81 62 84 81 -.64 -,85 “1.01 -1.05 1,39 -78 1,57 1,38 
118 51 66 76 77 85 86 -.04 -.03 -.50 -.49 1,17 1,22 1,60 1.67 
119 54 7 64 73 68 68 -.15 -,13 -~.78 -.78 83 1,05 .93 93 
120 67 76 56 54 76 67 -.80 -.82 -.93 -1.05 67 -64 1,17 91 
Adjective 
121 49 58 67 73 68 Si 102 02 -.28 ~.37 91 1.07 93 59 
122 56 60 69 66 72 57 -.24 —.25 -.35 ~.44 95 -87 1,03 . 69 ! 
123 33. 45 53 46 65 48 81 94 19 .25 63 51 .85 055 | 
124 40 55 71 68 66 67 237 38 -.18 -.18 1.00 ~92 89 91 ! 
125 35 41 57 33 66 44 -68 1.18 ~33 50 . 69 235 .88 49 
126 53 61 63 65 70 58 -.13 -.12 -.40 -.48 82 85 97 70 
127 37. 49 52 43 62 52 64 76 -04 .05 . 60 48 80 . 60 
128 38 647 69 48 61 48 «46 65 13 17 94 255 .78 255 ; 
129 33. 41 69 62 81 64 62 . 69 -30 137 96 -80 1,37 84 ; 
130 47 54 67 56 69 58 a2 14 -.16  -.19 89 68 95 71 
1314 17 20 44 27 51 29 2.15 3.52 1.68 2.96 49 . 28 .59 30 
1329 20 19 08 15 #413 «12 11.23 5.82 6.54 7.59 .08 15 14 ol? 
Helping Verb 
1339 30 25 31 18 41° 31 1.68 2.95 1.63 2.15 +33 ~18 245 233 
134 53 66 63 59 64 72 -.ll -.11 ~.67 -. 60 81 73 .83 1.03 
135 59 74 67 48 64 43 -.35 -.48 -1.01 ~1.50 .90 255 .83 48 
136 44 51 59 43 45 39 2 25 +34 -.05 -.06 73 . 48 Sl 43 
137 46 63 59 49 60 57 18 «22 -.57 -.60 74 56 74 . 69 
138 47 52 54 43 56 40 12 16 -.08 -, ll 65 - 48 67 744 
139 35 41 35 36 SS. 36 1.10 1.08 . 40 . 60 37 38 .66 39 
140 55 66 59 60 S52 S54 -.21 -—.20 -.B1 -.78 73 75 62 65 
16 GPO 6827-57674 
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Table 6, (Continued) 


Percent Biserial R Xso Beta 
Item Correct Boys Girls Boys Girls Bovs. Girls 


No. B G CT C T Concept Task Concept_ Task Concept Task Concept Task 


Helping Verb (continued) 


141 40 41 52 31 59 49 .50 84 37 45 ,6] 132 74 256 
142 30 36 S7 39 SO 35 91 1.35 275 1.05 ,69 42 657 .38 
143 31 36 40 35 54 39 1.27 1.44 . 69 94 44 .37 64 .43 
1444 20 17 -09 -23 09 =~05 9.60 3.70 11.18 19.28 -.0S -.23 .09 ~-.05 
Period 
145 83 94 58 61 66 64 -1,67 -1.59 -2.37. -2.47 71 77 89 83 
146 40 41 38 35 58 48 665 70 4n 48 41 37 70 55 
147 72 88 #83 86 66 76 -.70 -.68 -1.82 -1,58 1,3¢ 1.67 87 1.15 
148 58 71 S52 39 51 48 -~.37 -.49 -1.08 -1.15 6] 42 60 55 
149 48 64 67 63 68 6y .06 06 -.54 -.54 89 80 93 95 
150 64 79 58 50 61 53 -.62 -.72 -1.34 -1.54 71 57 76 62 
151 42 45 46 36 49 39 245 57 25 31 51 38 56 £43 
152 48 69 67 54 77 6% .06 .08 ~,63 ~.73 90 63 1.23 £93 
153 63 78 84 75 76 79 -.,41 -.46 -1,00 -~.96 1,52 1.12 1.18 1.29 
154 74 86 63 60 82 72 -1,00 -1.05 -1.34 -1.52 ,82 75 1.44 1,05 : 
155 42 60 57 45 73 55 £33 42 -.34 -.45  ,69 51 1.08 .67 : 
156 64 73 S4 48 68 54 -,66 -,.75 -.89 -1.11 .65 £54 .92 .65 
Possessive Noun 
157 61 76 71 68 62 70 -.38 -.40 -1.15 -1.01 1,02 93 -78 .99 Ai 
158 70 76 69 66 66 71 -.77 -.82 -1.08 -1.00 .96 87 . 87 .99 
159 47 58 €t€9 46 67 48 12 18 -.31 -.44 97 £52 £91 £54 i 
160 60 72 43 46 53 39 -,60 -.58 -1.08 -1.46 ,48 50 . 63 243 : 
161 Sl 61 54 41 70 48 -.02 -.03 -.39 -.56 ,64 045 .97 655 
162 46 54 67 58 63 46 .16 19 -.18 -.24 90 71 80 52 : 
163 47 56 52 42 56 4} 16 20 -, 29 -.39 61 46 68 45 
164 57 68 71 56 63 63 -.25 -~.31 -.74 —.74 01 68 80 81 
165 46 52 71 65 76 65 15 17. 1.95 —.08 01 85 1.18 85 
166 42 61 58 72 64 64 235 28 -.44 -.43 71 1.02 82 84 ' 
167 34 39 43 37 54 60 96 1.14 52 .47 48 39 64 74 | 
1688 20 20 31 22 43 28 £2.63 3.72 1.97 2.96 33 23 47 30 
Predicate : | 
169 47 52 61 49 64 55 wll 14 -.07 ~.08 .76 56 .B4 .66 : | 
170 48 51 5S 51 61 53 .10 ll -.04 -.05 .65 59 .77 .62 
1714 41 51 45 24 51 30 .48 89 -.03 -.05 51 25 ~59 31 
1724 46 60 S56 42 48 27 JL? 22 -.52 -.91 68 46 ~55 28 
173 40 44 46 34 55 32 154 73 27 48 51 3€ .66 33 
174 45 54 62 48 70 57 .22 28 -.16 -.20 79 55 ped 70 
175 51 61 63 46 65 55 -,02 ~=,03 -.45 -.52 gl 52 85 67 
176 42 53 68 65 68 55 .30 31 -.09 -.12 93 85 .93 65 
177 37 53 65 48 70 S51 .50 68 -.09 -.12 86 55 .98 59 
178 44 59 72 61 70 59 .21 24 -.31 -.37 1.05 77 99 73 
179 37 42 57 42 69 53 .60 82 28 .36 69 46 95 63 
180 37 54 56 53 73 64 .62 64 -.14 ~.16 67 63 1.06 84 
Present Tense : 
181 60 75 74 66 83 79 -.33 ~.37 -.81 -.85 1.10 87, 1.50 1.28 
182 68 82 71 78 79 79 -.65 =.59 -=1.15 -1.16 1.00 1.25 1.29 1.28 
183 59 72 58 48 77 68 -.37 ~=.45 -.75 -.86 .72 55 1.20 192 : 
184 66 76 73 64 79 64 -.55 -.63 -.91 -1.12 1.06 .83 1.28 84 | 
185 55 79 74 58 82 73 -.18 -.23 -.99 -1.11 1.11 72 1.41 1.08 
186 34 38 49 44 58 52 82 ~ ,90 51 -58 56 50 .72 .60 
i 
17 | 
j 
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Table 6. (Continued) 
~ Percent Biserial R X50 Beta 
Item Correct Boys Girls Boys Girls Boys Girls 


No. 8B G Ge of CT Concept Task Concept Task Concept Task Concept Task 


Present Tense (continued) 


187 34 32 56 43 40 36 75 .98 1.14 1,28 67 47 44 38 
188 46 53 58 45 67 62 19 .24 -.1 -.12 71 51 91 79 
189 58 63 54 38 53 49 -.38 -.54 -, 60 -.65 64 41 63 .56 
190 41 46 49 48 52 30 645 645 18 31 56 255 61 31 
191 56 69 78 6? 79 67 ~.19 -.24 -, 63 ~.74 1.23 80 361,29 91 7 
1924 25 28 19 SE 46 30 3.58 2.58 1.26 1.26 19 27 651 31 : 
Pronoun : 
193 68 83 70 61 73 477 ~.68 -.78 -1.29 -1,22 .98 77. 1.06 1,2! : 
194 44 66 73.73 70 75 ey, .22 -,58 -.54 1.67 £05 OF 1.12 
195 45 51 51 37 69 54 27 .36 -.05 -.06 £59 .40 96 .65 : 
196 60 70 55 53 64 60 -.47 -.49 -.79 -.84 . 66 .62 84 76 : 
197 40 36 40 40 45 36 65 .65 82 1.04 43 .43 50 38 : 
198 51 53 65 64 67 59 -.04 -.04 -.09 Sel 86 .B4 90 72 j 
199 45 44 55 55 62 61 .22 .22 23 23 .65 66 .80 .78 ‘ 
200 52 70 58 59 74 59 -.09 -.09 -,72 -.90 72 .72  =1,09 73 i 
202 48 62 63 54 70 49 .09 10 -.43 -.61 81 .64 99 £56 : 
202 43 44 58 49 67 63 30 .36 24 25 .72 £56 £91 82 ; 
203 30 36 52 46 51 56 1.01 1.13 71 65 . 60 52 . 60 .67 ; 
204 29 39 65 48 59 59 .85 1.16 49 49 85 £54 73 73 : 
Question Mark } 
205 70 Bl 79 65 88 75 ~.66 -.80 -1.01 -1.20 1.30 .87 1,90 1.12 
206 53 65 64 59 73 71 -.ll -.11 -.54 -.55 83 73. 1.07 1.01 i 
207 74 89 71 62 71 59 ~.90 -1.01 1.71 -2.06 £99 .80 1,02 £73 i 
208 88 92 68 69 88 69 -1.71 -1.69 -1.59 -2.04 £92 94 1.83 .94 4 
209 63 86 73 65 76 70 -.45 -.51 1.41 ~1.53 1.07 86 1,16 .97 
210 64 76 75 63 95 77 4.48 -=.57 ~.74 =,91 “115 .80 2.91 1.20 3 
211 35 59 60 57 74 64 .62 .65 -,32 -.37 275 70 31,11 83 { 
212 858 74 54 57 75 6 -—.38 -.36 -.85 -,97 .64 .69 1,12 . 86 i 
213 74 84 79 68 78 56 -.82 -.96 -=1,29 “1.79 1.31 92 1.24 .67 4 
214-77: 86 =— 77: GO 72 60 0.95 71,22 0 149-179 «21021020 761,02 74 ] 
215 72 86 77, 55 79 60 -—.74 -1.04 1,39 -1,84 1,21 .65 1.30 275 ‘ 
216 66 78 62 51 62 45 —.67 -.82 -1.26 -1.73 79 59 .80 251 } 
Sentence a 
217 54 72 69 64 75 62 =—.14 -,15 -.78 -.95 £95 .84 1,14 .79 i 
218 50 76 71 67 84 76 .00 .00 ~,83 -.91 1.01 91 1,52 1.18 5 
219 61 80 75 70 92 81 -—.38 -.41 -.92 -1.05 1.12 99 2.42 1.39 : 
220 75 80 45 43 45 40 -1.49 -1.55 -1.90 2.13 50 47 £50 .44 ‘ 
221 47 66 50 43 59 55 13 16 -,68 -.73 .58 .48 73 . 66 ‘ 
222 68 85 69 65 78 74 —.67 -.71 -1.33 1.40 .96 85 1.24 1.09 ‘ 
223 53 64 56 45 67 52 -.12 -,15 -.54 -.69 . 68 -50 91 62 ; 
224 63 77 74 65 80 77. -.44 -.51 -.94 -.97. 1.11 86 1.32 1.22 ‘ 
225 65 75 58 59 73 61 -—.65 -.63 -,93 ~1.13 .70 .73 ~=-1,08 .76 : 
226 64 79 75 68 72 63 =.47 =.53 =-1.11 ~1,27. 1.15 92 1.04 .81 i 
227 41 54 38 30 53 57 -58 .73 -.17 -.16 .41 31 63 . 69 4 
228 52 65 77, 59 76 79 =-.05 -.07 ~.50 ~.48 1,22 74 1,17 1.31 i 
Verb j 
2.29 63 77 42 44 59 53 —.78 -.75 <1.25 -1,37 .47 49 72 .63 | 
230 70 80 59 57 61 62 -—.91 -,94 -1.37. ~-1.36 «73 .70 77 .79 4 
231 48 58 83 73 84 57 06 .07  =-,23 -,34 1.51 1.06 1.54 <69 3 
232 54 53 61 57 71 Sl <-.16 ~=.17 -.10 -.14 .77 .70 »=©1.02 . 60 4 
18 4 
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233 53 
234 38 
235 49 
236 32 
237 55 
238 66 
239 61 
240 40 
Comparison 
241 64 
242 50 
243 65 
244 56 
245 39 
246 56 
2479 837 
248 62 
249 48 
250 65 
251 49 
2524 27 


Detail Sentence 


253 66 
254 78 
255@ 31 
256 52 
257 56 
258 56 
259 54 
260 48 
261 49 
262 55 
263 39 
264 28 
Ex planation 
265 72 
266 63 
267 35 
268 63 
269 59 
270 64 
271 45 
272 40 
2734 48 
274 59 
275 

276 48 
Greeting 
277 60 
2784 31 
279 80 


Percent 
Item Correct 
BG 


Boys 


_No. CT C__T Concept Task _-Concep 


Verb (continued) 


62 
50 
43 
61 
67 
68 
77 
56 


71 
60 
69 
69 
63 
72 
46 
81 
70 
62 
57 
30 


61 
44 
38 
66 
50 
71 
52 
66 
75 
82 
65 
48 


75 
71 
59 
60 
67 
72 
45 
70 
46 
70 


69 


70 
39 
69 


ept Task Concept Task Concept Task 


—_ 
. 8 


iw 
. 


r«) 
ERIC 


Item Correct 


Percent 


280 65 75 78 
281 68 76 (exe) 
2824 24 31 18 
283 37 44 37 
284 65 80 65 
285 63. 73 79 
286 58 74 77 
287 82 91 71 
288 38 «52 58 
Heading 
289 72 = «87 62 
290 76 90 62 
291 43 45 63 
2929 34 45 48 
293 24 «25 41 
294 48 58 57 
295 46 58 61 
296 40 51 68 
297 42 47 65 
298% 34 39 42 
299 
300 34 42 57 
Paragraph 
301 55 73 72 
302 45 64 66 
303 74 88 76 
304 61 68 54 
305 56 78 76 
306 71 «77 59 
307 58 64 63 
308 60 64 78 
309 66 65 70 
310 47 60 33 
311 
312 59 74 67 
Return Address 
313 90 97. 63 
314 89 95 53 
315 78 89 77 
3169 46 52 32 
317 59 71 69 
318 52 64 71 
319 58 66 56 
320 67 80 73 
321 69 80 64 
322 40 58 61 
323 
324 47 60 68 
Thank You Letter 
325 63 79 74 
326 68 80 79 
20 


67 
63 


83 
82 


Biserial RK 
Boys Girls 


78 
68 


Table 6, 


Boys. 
No. BG Cc. T CT Concept Task Concept Task Concept Task Concept Task 


Greeting (continued) 


-.48 
-.69 
3.96 
.88 
-.57 
-.44 
-.27 
-1.27 
04 


-.94 
-1.14 
. 28 
87 
1.75 
-10 
015 
. 36 
231 
-99 


74 


-.19 

19 
-.86 
-.50 
-.20 
-.93 
-.30 
-.33 
-.59 

. 20 


-.34 


-2.02 
-2.34 
-1.02 
33 
-.32 
-.08 
-.34 
-.99 
-.77 
43 


10 


-.44 
-.60 


-.63 
~.69 
19.97 
79 
-.58 
-.46 
~.33 
-1.50 
.56 


-.83 
-1.06 
61 
3.11 
2.36 
«17 
19 
50 
41 
2.77 


«85 


-.19 
20 
-.83 
-.68 
-.23 
-1.19 
-.36 
-.39 
-.67 
222 


-.36 


-1.97 
“1.95 
-1.19 
81 
-.38 
-.09 
-.4) 
-.70 
-.90 
46 


-10 


-.49 
-.75 


(Continued) 


X50 
Girls 


-.89 
-1.16 
1.94 
. 30 
-1.12 
-.74 
-.80 
-1,68 
~.07 


-1.99 
-2.31 
18 
17 
95 
-.36 
-.31 
-.02 
09 
256 


33 


-.77 
-.51 
-1.46 
~.71 
-1.08 
-1.01 
-.53 
-.38 
-.55 
-.48 


-.97 


-4.80 
-2.03 
“1.54 
~.10 
-.93 
-.56 
-.77 
-1.20 
-1.40 
-.36 


-.37 


-.98 
-1.01 


26 


-.84 
-1.37 
4.87 
.50 
-1,12 
-.83 
-.94 
-2,16 
~.08 


-1.34 
-2.17 
232 
.36 
1.73 
-.58 
-.29 
~.03 
oll 
1.00 


46 


-.87 
-.55 
-1.39 
-.75 
-1,23 
-1.36 
-.52 
-.40 
-,.68 
-,66 


-1.09 


-4.17 
-3.82 
-1,.86 
-.16 
-1.39 
-.65 
-.82 
-1.79 
-1.57 
-.50 


-.48 


-1.08 
-1.22 


Boys 


1.25 
-89 
18 
-40 
87 

1,27 

1.19 

1.02 
71 


-80 
78 
81 
294 
°45 
. 69 
.78 
92 
»85 
46 


. 69 


Beta 


74 
89 
04 
46 
83 
1.11 
79 
075 
. 69 


1.00 
88 
30 
14 


-90 
82 


Girls 


1.48 
1.42 


1.38 
60 
ell 
232 

1.10 

1,04 
695 
77 
.65 


1,60 
075 
40 
40 
43 
239 
.86 
66 
66 
.30 


.ol 


98 
87 
1.57 
.80 
.80 
64 
1.01 
1.74 
71 
41 


71 


50 
46 
87 
34 
245 
.67 
.60 
252 
63 
41 


~65 


1,13 
92 


(<) 


ERIC 


Table 6, (Continued) 
Percent Biserial R X59 Beta 

Item Correct Boys Girls Boys Girls Boys. Girls 

No. B G Cc oT CT Concept Task Concept Task Concept Task Concept Task 
Thank You Letter (continued) 
327 82 91 72 64 68 74 -1.26 -1.42 -1,96 -1.78 1,04 82 .92 1,11 
328 53 76 60 45 64 62 -.13 -.18 -1,12 -1,.16 275 -50 .B4 .79 
329 75 90 76 69 69 59 -.90 -.98 -1.83 -2.15 1.16 .96 94 172 
330 50 72 73 64 83 72 -00 00 -.71 -.82 1.07 -82 1.48 1.03 
331 62 54 53 46 51 43 -.56 <-.65 -.18 -.21 63 -52 .60 .47 
332 65 84 83 71 96 72 -.45 -.52 -1.05 -1.40 1.49 1.02 3.24 1.03 
333 62 81 70 66 89 79 -.45 -.48 -.97 -1.10 .99 -89 1.95 1.28 
3°34 83 89 72 60 80 56 -1.31 -1.57 -1.54 -2.22 1.04 .76 1,34 . 67 
335 
336 57 68 51 56 71 59 -.34 -.32 -.65 -.80 . 60 .67 1.02 72 
Title 
337 80 90 54 56 65 60 -1.53 -1.48 -1.92 -2.11 .64 . 68 .87 .74 
338 68 89 78 77 74 78 -.59 =-.60 -1.64 -1.57 1.25 1.21 1.11 1.23 
339 73 89 67 60 72 67 -.90 -.99 -1.70 -1.80 .89 .76 «61.03 91 
340 66 81 60 45 50 46 -.67 -.89 -1.76 -1.93 275 51 £58 51 
341 69 76 61 68 57 55 -.80 -.73 -1.24 -1.29 .77 92 .69 .66 
342 54 70 76 64 76 75 -.12 <=-.15 -.70 -.71 1.16 -84 1,17 1.15 
343 45 47 47 40 41 30 . 26 .3l 18 -24 293 43 46 631 
344 47 57 82 75 79 69 -10 ell -.23 -.26 1.42 1.12 1.29 .94 
345 57 70 65 61 79 62 -.27 -.29 -.66 -.84 .85 -77 = 1.231 .79 
346 59 77 67 56 76 Sl -.32 -.39 -.97 <-1,43 .90 .68 1.15 . 60 
347 53 62 55 44 54 49 -.15 -.18 -.57 -,63 .65 49 .65 -56 
348 47 59 58 42 62 50 14 19 -,35 -.44 .71 46 .79 057 
Topic Sentence 
349 50 65 50 44 60 54 -00 .00 -,66 -.72 .57 49 75 .64 
350 50 48 39 30 52 38 -00 00 .10 14 42 .3l . 62 41 
351 44 69 65 57 60 52 .23 . 26 -,82 -.94 . 86 . 69 .74 61 
352 36 647 57. 55 64 50 .63 65 13 16 . 69 .65 233 -58 
353 65 75 65 56 64 59 -.59 <-.69 -1,05 -1.14 .86 . 68 .83 «72 
354 42 63 72 62 76 70 . 28 233 -.44 -.47 1.03 .80 1,16 .98 
355 42 54 44 46 §2 57 +47 245 -.15 -.18 48 51 95 .70 
356 53 70 75 70 78 79 -.11 -.12 -.66 -.66 1.13 98 1.26 1,29 
357 41 57 66 60 78 79 035 39 -.22 -,.22 .88 74 1.24 1.29 
35848 18 19 00 -O7 26 18 677.95 13.44 3.35 4.77 -00 -.07 27 -18 
359 31 38 41 34 42 37 #1.19 1.43 74 .85 045 .36 46 039 
360 37. 40 58 45 47 42 .59 76 54 259 71 51 653 46 


footnoted in Table 6, 


Of these 22 items, 16 


were too difficult as indicated by an X59 value 
However, for most of these 
16 items, the Betas are essentially zero which 
causes the Xsq to become meaningless. Seven- 
teen other items were very easy (Xso value less 
than -2.00) but nevertheless were contributing 


greater than 2.0. 


to overall reliability. 


Generally, the items 


are distributed adequately across a range of 


ad 


difficulty. The fact that 94% of the items dis- 
played no obvious weaknesses implies that the 
test data resulting from the items can be used 
in the planned factor analytic studies, The 
Hoyt reliability estimate for each of the con- 
cept and task scores is also encouraging. 
Thus, considering the magnitude of the reli- 
ability estimates, the acceptable levels of 
difficulty generally achieved, and the gener- 


21 


m~, 
ye 
ally high discrimination indices of the items, items constructed and to attempt to delineate 
| it seems possible to proceed with attempts to the particular cogr.itive abilities responsible 
d determine the factors embedded in the test for concept attainment. 
22 
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IV 


Summary and Conclusions 


* 


The primary objective of the project en- 
titled "A Structure of Concept Attainment Abil- 
ities" is to formulate one or more models or 
structures of concept attainment abilities, and 
to assess their cgnsistency with actual data. 
One of the major steps for attaining this primary 
objective was taken to be the development of 
tests to measure achievement of selected lan- 
guage arts, mathematics, science, and social 
studies concepts appropriate at the fourth grade 
level. This paper describes the test develop- 
ment efforts and presents the item and total 
score statistics obtained using the revised 
items developed for measuring achievement 

of selected concepts in language arts, 

Subject matter specialists identified sin- 
gle or compound word classificatory concepts 
for three major areas, and randomly selected 
ten from each area to be studied. These 30 
selected concepts were then analyzed. Twelve 
items for each concept were developed; one 
for each of the first 12 tasks of "A Schema for 
Testing the Level of Concept Mastery" (Frayer, 
Fredrick, & Klausmeier, 1969). 

The items that were developed were admin- 
istered to 186 boys and 259 girls who had just 
begun the sixth grade during the fall of 1370. 
These data were item analyzed, separately 
for boys and for girls, using the GiITAP program 
(Baker, 1969). 

The means, standard deviations, Hoyt 
reliability estimates, and standard errors of 
measurement are presented and discussed for 
total concept and total task scores. Four dif- 
ferent item indices—percent correct, item- 
criterion biserial correlation, X59, and B— 
obtained for each item based on each of two 
criterion scores, appropriate total concep 
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score and appropriate total task score, are 
presented and discussed. 


Conclusions 
The major conclusions drawn are: 


1. The reliability estimates obtained for 
both total concept scores and total 
task scores are sufficiently high to 
warrant study of the dimensionality 
of these selected language arts con- 
cepts and the dimensionality of the 
tasks when using language arts con- 
tent. 


2, The difficulty item indices obtained 
indicate that these items are of appro- 
priate difficulty levels for these sub- 
jects. 


3. Almost all of the items have desirable 
levels of discrimination indices when 
the item is both a part of a concept 
criterion score and a task criterion 
score. 


Recommendation 


The completely crossed design used to 
construct these achievement tests is a very 
interesting one. This type of design might 
well be used more often in the future. It 
would be highly desirable to have available 
item analysis procedures that are appropriate 
for analyzing suck crossed designs. At the 
present such a methodology is not known. | 
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